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Abstract: Driver assistance systems required by Daimler and Volvo auto^mtfffNewbr their future generation 
cars are to be designed in order to detect dangerous situations involvinC^Sssfrians ahead of time, allowing 
the control the vehicle. In order to meet those challenges, weiS^)^ a Generic Framework. The 
framework gives the structure and outline for the active researchassVu^d at improving traffic safety. The 
necessary components for monitoring and reaching a safe statedcM^eir embedment in a basic, functional 
Architecture of a driver assistance system are shown in the frampwrk. This paper also provides the various 
phases for pedestrian tracking and driver assistance systern^es «t collective framework which can be utilized 
by people who apply different approaches in their wori^^^ ideas from different work are also collected 
and this study highlights the optimal approaches provW^d in those proposals. 
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The first investigations on pecusstrfa^racking for Pedestrian Protection Systems were presented in the late 
1990s. Since then, Pedestrian "Bracking has become a hot technological challenge that is of major interest to 
governments, automotive agwraanies, suppliers, universities, and research centers. As a result, many papers 
addressing on-board peo^smjli detection have been published, a few of which partially survey the state of 
the art. The main futnre^i^ in this research area is visual pedestrian detection and tracldng from a moving 
vehicle. More reseafi^Vs needed before such systems can perform active vehicle control reliably. The 
contribution misjgtudy is two-fold. First, it presents a general module-based architecture that gives a 
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fystems, pointing out the current limitations and future trends from a more general 
viewpoi^jw^ll the highlights of the related works are listed out in section 2. In section 3, we propose a 
Gene/Tc^ramework under which the various modules such as segmentation, pedestrian classification, 
^edwNien tracldng, risk assessment and warning control strategies are discussed from a more general 
fWalective. Section 4 gives the conclusion of this paper which is aimed at helping researchers in the field of 
pedestrian tracking and driver assistance systems. 

2. RELATED WORKS 

Markus Enzweiler et al. [1] proposed an overview of the main components of a pedestrian detectionsystem 
and the underlying models from both methodological and experimental perspectives. Two evaluation 
settings: a generic setting, where evaluation is done without scene and processing constraints and one 
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specific to an application onboard a moving vehicle in traffic were considered. The HOG-based linear SVM 
approach significantly outperformed all other approaches considered at little or no processing constraints. 
D. M. Gavrila et al. [2] proposed a multi-cue vision system for real-time pedestrian detection and tracking 
from a moving vehicle. This paper analyzed the performance of individual modules and their interaction by 
means of Receiver Operator Characteristics and the performance was furthermore enhanced by a restriction 
of the sensor coverage area and more processing time. Cao Yuzhen et al. [3] proposed a method for 
extracting pedestrian crossing based on image processing, which contains bipolarity testing, morphological 
operations, edge detection and Radon Transform techniques. The algorithm was proved to have a hkjh 
recognition rate in pedestrian crossing detection. David Geronimo et al. [4] proposed a system that drfPIc^ 
pedestrians from a moving vehicle in urban scenarios and searches for aspect changing objects in aJstf^red 
environments. It has also proposed a strategy to combine 2D/3D information in a cooperat^eVaxIdule 
scheme where the output results of each step are used as input of next. In this way, 2D and 3^bues are 
exploited in each step depending on the task to be achieved and taking into account th£ lj^jfafions of the 



data. Dariu M. Gavrila et al. [5] proposed a novel probabilistic approach to hierarchkaj^wemplar based 
shape matching. The approach uses a template tree to efficiently represent and matdf/yvariety of shape 
exemplars. The main contribution of this paper is a Bayesian model to estimate th«Qip)steriori probability 
of the object class, after a certain match at a node of the tree. N^r 

Markus Horwick et al. [6] explained the difference between fully a«tomajic and autonomous driving 
assistance systems. It proposes two different strategies to reach a rafc^rae in consequence of a system 
boundary crossing. The strategies and components of the safety con/eptprKented in this work are crucial 
for guaranteeing enduring safety in such DAS and in consequenq flfr ^making automatic driving functions 
commercially ready for serial production. W. Jianqiang et al.y^Lpresented a driving simulation platform 
with low cost for the development of driving assistance systdjfls (DAS). It illustrates that the proposed 
control algorithms for actuators possess good trackingtejApa'bility, as well as that the developed ACC 
algorithm is capable of improving driver comfort and rCT^Eing driver workload. The proposed adjustment 
method for vision rendering software further strened^* driver's immersion feeling on virtual traffic scene, 
improving its reliability of disclosing driver charefc^istics. Evdokimos I. Konstantinidis et al. [8] proposed 
the development and evaluation of a system targe>fcig to vehicle collision avoidance in emergency situations 
by wireless communication among vehiclgO^he maximum covering range discussed provides sufficient 
time to drivers in order to act and avoidfc^ossible collision. This low cost and low power consumption 
system can be easily installed and intefrrajea to any vehicle, old or new, as it operates independently of the 
rest vehicle's electronic systems, glt^l^^e Kuo et al. [9] proposed a vision-based vehicle detection method 
for collision warning of driver\ssistVice system on highway in the nighttime. The major function of their 
work is to find preceding verfclas in the dynamic background by extracting the tail lights of vehicles by 
using multi-level imaga p^£|s!sing algorithms and cluster processing and also estimating the related 
distance between the |CT<£rar and the preceding vehicle for collision warning. LP. Alonso et al. [10] 
proposed a comporjftA»«Dased learning approach in order to better deal with pedestrian variability, 
illumination condi*K%fr partial occlusions, and rotations. Extensive comparisons have been carried out 
using different^feS^j/e extraction methods as a key to image understanding in real traffic conditions. 

t <v 

A. BroggiAtVl. [11] proposed the application of a stereoscopic technique as a preprocessing for the 
localizafij^of humans in generic unstructured environments. Each row of the left image is matched with 
thj^frh^lar row of the right image. This creates a map of each object in the scene as well as the slope of the 
^adYTvL Enzweiler et al. [12] presented a novel approach to pedestrian classification which involves 
unJiiEing the synthesized virtual samples of a learned generative model to enhance the classification 
performance of a discriminative model. Active learning provides the link between the generative and 
discriminative model, in the sense that the former is selectively sampled such that the training process is 
guided towards the most informative samples of the latter. L. Petersson et al. [13] discussed about driver 
assistance systems, lists a set of necessary core competencies of such a system and in particular presents a 
system for force-feedback in the steering wheel when crossing lanes. The presented system utilizes a robust 
lane tracker which is experimentally evaluated for the purpose of driver assistance. M. Bertozzi et al. [14] 
proposed a vision-based system for detecting and localizing pedestrians in road environments by means of 
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a statistical technique. Initially, attentive vision techniques relying on the search for specific characteristics 
of pedestrians such as vertical symmetry and strong presence of edges, allow selecting interesting regions 
likely to contain pedestrians. These regions are then used to estimate the localization of pedestrians using a 
Kalman filter estimator. M. Bertozzi et al. [15] presented an implementation of a vision-based system for 
recognizing pedestrians in different environments and precisely localizing them with the use of a Kalman 
filter estimator configured as a tracker. The information produced is then passed on to the tracker module 
which reconstructs an interpretation of the pedestrian positions in the scene. 
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3. GENERIC FRAMEWORK 

The generic framework presents a general module based architecture that gives a general ^sAljjre f 
pedestrian detection and driver assistance tasks in fig 1. Generic Framework includes the varioV^iodules 
such as segmentation, Detection, pedestrian classification, pedestrian tracking, risk ^pestment and 
warning control strategies. The images captured by the sensors are preprocessed and the^^gmented. Then 
the pedestrians are detected based on their edges and shapes through various technkwe^The pedestrians 
are classified based on the example training datasets and the speed and direction^ftnV mobile pedestrians 
are tracked. The warning control strategies are assessed and necessary control^Stions are provided to the 
automobile brake control system. 



3.1 Segmentation 



Segmentation is a process which is used to simplify or chan^Lflw representation of an image into 
something that is more meaningful and easier to analyze by assfQ^ji^ a label to every pixel in an image such 
that pixels with the same label share certain visual charactefccics. Various techniques can be used by 
researchers such as threshold techniques, edge-based me*J^l£ region-based techniques, and connectivity 
preserving relaxation methods. 




Fig 1: Generic Framework for Pedestrian tracking and driver assistance system. 
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Clustering methods 

The K-means algorithm is an iterative technique that is used to partition an image into K clusters. 

Compression-based methods 

Compression based methods postulate that the optimal segmentation is the one that minimizes, over all 
possible segmentations, the coding length of the data. 

Histogram-based methods 

Histogram-based methods are very efficient when compared to other image segmentation meth«4g/because 
they typically require only one pass through the pixels. In this technique, a histogram is^qffiaylfed from all 
of the pixels in the image, and the peaks and valleys in the histogram are used to locata^^nusters in the 
image. YVW 

Edge detection 

Edge detection is a well-developed field on its own within image proems hj^^egion boundaries and edges 
are closely related, since there is often a sharp adjustment in intensity^^^egion boundaries. 

Partial Differential Equatioi^JMiods 

One suitable method for image segmentation is to use a Partial^^rferential Equation (PDE) and solve it by 
a numerical scheme to get the image segmented. 




Graph partitiramg methods 

Graph partitioning methods can effectively be us^for image segmentation. In these methods, the image is 
modeled as a weighted, undirected graph. l*u^ly a pixel or a group of pixels are associated with nodes and 
edge weights define the dissimilarity betw|emthe neighborhood pixels. The graph image is then partitioned 
according to a criterion designed to wCd^ good" clusters. Each partition of the nodes (pixels) output from 
these algorithms are considered afa^ect segment in the image. 

Watershed transformation 

The watershed transforf™Wn considers the gradient magnitude of an image as a topographic surface. 
Pixels having the hifSAtrgradient magnitude intensities (GMIs) correspond to watershed lines, which 
represent the regies ^pundaries. Water placed on any pixel enclosed by a common watershed line flows 
downhill to a clmjn^n local intensity minimum (LIM). Pixels draining to a common minimum form a catch 
basin, which^^||^sents a segment. 

Multi-scale segmentation 

fe segmentations are computed at multiple scales in scale-space and sometimes propagated from coarse 
'e scales. More recently, these ideas for multiscale image segmentation by linking image structures 
over scales have been picked up. Structures detected in scale-space above a minimum noise threshold are 
associated in an object tree which spans multiple scales and corresponds to a kind of feature in the original 
signal. Extracted features are accurately reconstructed using an iterative conjugate gradient matrix method. 
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3.2. Detection 

Module for human shape filtering can be developed to detect the pedestrians based on their edge, shape 
and movement orientation features. The Pedestrian Detection functionality is aimed at sensing and 
localizing the objects with a human shape. Pedestrians are detected through a search for objects featured by 
specific characteristics, using a single monocular image sequence. Shape Analysis and classification 
provides a rich resource for the computational characterization and classification of general shapes, from 
characters to biological entities. The shape of each segment is described both by its significant bounclajff 
sections and by regional, dense orientation information derived from the segment's shape. Shapebased^^^ 
techniques allow the recognition of both moving and stationary pedestrians. Edge detecti^R^^ a 
fundamental tool in image processing and computer vision, particularly in the areas of featura^c^rction 
and feature extraction, which aim at identifying points in a digital image at which the image\jjlghtness 
changes sharply or more formally has discontinuities. Numerous approaches have been r^jo^j^cfc 

Holistic Detection /v^^ 

Detectors are trained to search for pedestrians in the video frame by scanMB me whole frame. The 
detector would "fire" if the image features inside the local search windov^tti^st certain criteria. Some 
methods employ global features such as edge template, others uses locaJtfettuVs like Histogram of oriented 
gradients descriptors. The drawback of this approach is that, the j^fcNaance can be easily affected by 
background clutter and occlusions. Z 1 ^^^ » 

Part-based Detecj 



Pedestrians are modeled as collections of parts. Part htaAth%ses are firstly generated by learning local 
features, which includes edge let features, the orientatjjGN»atures, and etc. These part hypotheses are then 
joined to form the best assembly of existing pedestr«^typotheses. Though this approach is attractive, part 
detection itself is a difficult task. 

based Detection 

A codebook of local appearance is leaf^djduring the training process. In the detecting process, extracted 
local features are used to matctroS^inst the codebook entries, and each match casts one vote for the 
pedestrian hypotheses. Final tetectmn results can be obtained by further refining those hypotheses. The 
advantage of this approach is Cilj>a small number of training images are required. 

3-3 Pedestrian Classification 

The acquired im; classified into pedestrians and non-pedestrians based on the available images in 

the training da^^^t by shape-based pedestrian detector that matches a given set of pedestrian shape 



templates ti^^^images. Pedestrian images were obtained from manually labeling and extracting the 
rectanguli^pSeitions of pedestrians in video images. Video images were recorded at various times and 
locatiojft^rm no particular constraints on pedestrian pose or clothing, except that pedestrians are standing 
jn-jilfcig/t position and are fully visible. As non-pedestrian images, patterns representative for typical 
preprocessing steps within a pedestrian classification application, from video images known not to contain 
any^edestrians. We can use a shape-based pedestrian detector that matches a given set of pedestrian shape 
templates to distance transformed edge images. The ability to automatically detect pedestrians in images is 
a key for a number of application domains such as surveillance and intelligent vehicles. Large variations in 
pedestrian appearance (e.g. clothing, pose) and environmental conditions (e.g. lighting, background) make 
this problem particularly challenging. A typical approach starts by identifying regions of interest in the 
image using a computationally efficient method (e.g. background subtraction, motion detection, obstacle 
detection) and thereafter moves on to a more expensive pattern classification step. 
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3.4 Pedestrian Tracking 

Once the image is been classified into pedestrians and non-pedestrians, the next step is to keep track with 
direction and speed of the pedestrians who are in mobile state. The tracking component aggregates 
perframe detections to trajectories by a tracking module. The tracking is performed in the high- 
dimensional space of shape model parameters which consists of Euclidean transformation parameters and 
deformation parameters. Some methods are Pedestrian Tracking Based on Colors and Spatial Information, 
Modified particle filter-based infrared pedestrian tracking, pedestrian tracking using discrete choice modds 
and image correlation techniques. In human tracking, the tracldng algorithms can be categorized intnraur* 
groups: region-based, contour-based, feature-based and model-based. The first three groups suffer fiffl^p 
common disadvantage in handling occlusions, while the model-based tracking algorithms S$g/ very 
consuming and could not be used in real time. Since most of the solutions proposec^^ these 
methodologies are computationally expensive, Kalman filtering is still the most commonl^i^^ algorithm 
for tracking. ^^/^ 

3.5 Risk Assessment and Control Strategy 

Finally, the risk assessment and warning/control component evaluates thefo^mbility of collision; if the 
latter exceeds a threshold an acoustic driver warning is given or automatic ^ellde braking is applied by the 
automobile brake control system to either avoid the accident entirelwX|x^^east minimize the severity of 
the hit. 



Beside the adherence of basic principles and methods foi^Mactional safety, the strategies and components 
of the safety concept presented in this work are crucialtffe*guaranteeing safety in vehicle driver assistance 
systems. The conventional meaning of the word "safi^^oncept" aims at assuring and guaranteeing, that a 
certain product fulfills certain tasks faultlessly. ^SA achieve this, our paper provides various phases for 
tracking the pedestrians and driver assistance ;!}items as a generic framework which can be utilized by 
people who apply different approaches^^^iheir work. Altogether we are optimistic about future 
achievements in this field of research. 
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